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We present high energy spectra and zenith-angle distribu- 
tions of the atmospheric muons computed for the depths of the 
locations of the underwater neutrino telescopes. We compare 
the calculations with the data obtained in the Baikal and the 
AMANDA muon experiments. The prompt muon contribu- 
tion to the muon flux underwater due to recent perturbative 
QCD-based models of the charm production is expected to 
be observable at the depths of the large underwater neutrino 
telescopes. This appears to be probable even at rather shal- 
low depths (1-2 km), provided the energy threshold for muon 
detection is raised above ~ 100 TeV. 



I. INTRODUCTION 

Considerable literature exists on estimating the con- 
tribution to cosmic ray muon fluxes that arises from the 
decay of charmed hadrons p[HTl|. Current data on the 
high-energy atmospheric muon flux obtained with many 
surface and underground detectors are too conflicting to 
provide the means of probing charm production models 
(see, for example, [|j). 

Both direct and indirect measurements of the atmo- 
spheric muon flux at sea level are limited to ~ 70 TeV 
for the vertical and to ~ 50 TeV for the horizontal. Sta- 
tistical reliability of these data is still insufficient to eval- 
uate the prompt muon contribution to the high-energy 
muon flux. Available energies and the accuracy of un- 
derground measurements are constrained because of the 
restricted size of detectors and the uncertainties in the lo- 
cal rock density. Deep-sea installations have substantial 
advantages just due to large detector volume and homo- 
geneous matter. So it is relevant to discuss the potential 
of the large underwater neutrino detectors (AMANDA, 
Baikal), in the context of the prompt muon study, in fu- 
ture high-energy muon experiments. 

In this paper, we present calculations on zenith an- 
gle dependence of the high energy underwater muon flux 
taking into consideration the prompt muon fraction ob- 
tained in one of the recent perturbative QCD models of 
Pasquali et al. (hereafter pQCD) in which small-x be- 
havior of the gluon distributions is probed. This pQCD 
calculation based on MRSD- [jj) and CTEQ3 Q par- 
ton distribution functions (PDFs) includes the next-to- 
lcading order (NLO) corrections to the charm production 
cross sections. 

Perturbative QCD models differ in the PDF sets being 
employed in the NLO calculations and in the choice of 
renormalization and factorization scales. A dependence 



on these quantities of the vertical sea-level prompt lep- 
ton fluxes was studied in Refs. P, pl] , pd[ . The predictions 
of the pQCD model |j) are comparable to those of the 
earlier quark-gluon string model |15| and the recombi- 
nation quark-parton one (see |||| [jTThe muon spectra 
underwater obtained with the pQCD models and other 
types of the charm production models, the quark-gluon 
string model (QGSM) and the recombination quark- 
parton model (RQPM), were partly discussed in Ref. [jl0| . 
Here we would like to focus on variations in the expected 
underwater muon fluxes caused by distinctions between 
the PDFs used. In addition, we compare the expected 
underwater muon flux to the zenith angle distributions 
measured with the Baikal (lfi) and the AMANDA Jl|] 
neutrino telescopes. 



II. SEA-LEVEL MUON FLUXES 

The atmospheric muon energy spectra and zenith an- 
gle distributions of the conventional (jr, K) muons, and 
the RQPM and the QGSM contribution, have been com- 
puted using the same nuclear cascade model ||8|, |l8| , |l9f . 
Let us glance over its key assumptions. 

(i) The all-particle primary spectra and chemical com- 
position are taken according to Ref. pC| . Nuclei of the 
primary cosmic rays are treated as the composition of 
free nucleons. 

(ii) Feynman scaling is assumed to be valid for hadron 
produced in collisions of hadrons with nuclei of the at- 
mosphere. 

(hi) The inelastic cross sections cr^J 1 for interactions 
of a hadron h (= p,n,TV^) with a nucleus A grow loga- 
rithmically with the energy: 

afl l {E h ) = a° hA + a A ln^/lTeV). 

(iv) The hadron production in kaon-nucleus and in 
charmed hadron-nucleus collisions is neglected. 

(v) Charged pion is considered stable in the kinetic 
stage of the nuclear cascade (not in the stage of muon 
production, to be sure). 

(vi) Three-particle semileptonic kaon decays are 
taken into account. 

The energy spectrum of the conventional muons at the 
sea level calculated for the vertical can be approximated 
(see H) for energies > 1 GeV by the formula: 
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Here E^ in GeV, y = log 10 (^/lGeV), 

f(y) = 0.3061 + 1.2743?/ - 0.263y 2 + 0.0252y 3 ; 

Ai = 2.95 x 10- 3 ,A 2 = 1.781 x 10- 2 ,A 3 = 14.35, A± = 
10 3 (cm^s-^r-^eV- 1 ); Eh. = 1 GeV, E 2 = 928GeV, 
E 3 = 1587.8 GeV, Ei = 4.1625 x 10 5 GeV. 

The results of the calculations of the muon zenith- 
angle distributions at sea level are presented in Table || 
for high energies 1-100 TeV. The differential energy spec- 
tra (scaled by -E 3 ) of the conventional muons at sea level 
are shown (solid) in Fig. [I] for the vertical and near hori- 
zontal direction together with the data of the Notting- 
ham spectrograph |H| (one point at E^ ~ 1.3 TeV), 
the MUTRON spectrometer p2|1 , and indirect measure- 
ments p3|-p8|]. Open circles represent the MACRO best 
fit for the vcrical direction S] . (The detailed comparison 
between the calculated muon energy spectra for different 
zenith angles and the sea-level experimental data, in par- 
ticular for large zenith angles, as well as calculations of 
other authors, is made in Ref. [p9| .) Dashed and dot- 
ted lines in Fig. [l] correspond to the vertical muon flux 
including the prompt muon contributions calculated ||] 
with the CTEQ3 functions (pQCD-2) and the MRSD- set 
(pQCD-1). Line 1 (dashed) corresponds to the MRSD- 
set, line 2 (short dotted) corresponds to the CTEQ3 
PDF, both with factorization and renormalization scales 
fip = 2(j,r = 2m c , and with the charm quark mass m c = 
1.3 GeV. As evident from the figure, the pQCD predic- 
tions depend strongly on the PDF. 

For comparison there are also shown predictions of the 
charm production model of Volkova et al. (VFGS) jj| 



TABLE I. Ratio (£ M , (£ M , 0°) of differential 

energy spectra of the conventional muons at sea level as a 
function of seed. 
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FIG. 1. Sea-level muon fluxes for the vertical and hori- 
zontal. The solid lines are for the conventional muons alone. 
Also shown are the conventional muons plus the prompt muon 
contribution estimated with several models: the pQCD-1 
(dashed) and pQCD-2 (short dotted) for the vertical; the 
model of Volkova et al. (thin) for the vertical; the RQPM 
(dot-dashed) and QGSM (dotted) for the vertical (lower) and 
near the horizontal (up). 



(thin) and the results obtained with the RQPM (dot- 
dashed) and the QGSM (dotted), both for the vertical 
direction (lower) and near the horizontal (up). These re- 
sults enable one to make out the range of prompt muon 
flux predictions that overspread more than one order of 
magnitude at E^ ~ 1 PeV. It is interesting to note that 
old QGSM predictions |]|l5|] coincide practically with 
those of the pQCD-2 up to ~ 600 TeV, while the RQPM 
flux appears to be close to the pQCD-1 one. 

As is seen from Fig. [l], at E^ > 20 TeV none of the 
above models but the VFGS is consistent with the data of 
MSU [^3| and Frejus [Q. Conversely, none of the charm 
production models under discussion contradict the LVD 
data H& The VFGS, differing from the others in the 
extent of optimism, gives the greatest prompt muon flux 
that is scarcely compatible with the LVD upper limit |30| . 

The "crossing energy" E^(9) (the energy around which 
the fluxes of conventional and prompt muons become 
equal) depends on the choice of the PDF set. The ver- 
tical crossing energy E^(0°) is about 200 TeV for the 
pQCD-1 model, which is close to the RQPM prediction 
(E^ ~ 150 TeV). The vertical prompt muon flux pre- 
dicted with the pQCD-2 model becomes dominant over 



the conventional one at the energies E^ > 500 TeV. 
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Therefore, in order for the differences between the pQCD 
models to be found experimentally one needs to measure 
muon energies above ~ 100 — 200 TeV. 

III. MUON FLUXES UNDERWATER 

Muon energy spectra and zenith angle distributions 
deep underwater are calculated using an analytical 
method |n| (see also Ref. (|]). By this method one 
can solve the problem of the muon passing through 
dense matter for an arbitrary ground-level muon spec- 
trum and real energy dependence of differential cross 
sections of muon-matter interactions. The collision inte- 
gral on the right-hand side of the muon transport equa- 
tion describes the "discrete" energy loss of muons due to 
bremsstrahlung, direct e + e~ pair production and pho- 
tonuclcar interactions. 

In this paper the ionization energy loss and the part of 
the loss due to e + e~ pair production with v < 2 • 10~ 4 (v 
is the fraction of the energy lost by the muon) is treated 
as a continuous one: that is, the corresponding item is 
subtracted from the collision integral and transferred to 
the left-hand side as a partial derivative with respect to 
energy of the mean energy loss rate multiplied by the 
muon flux. 

The calculations of the prompt muon fluxes underwa- 
ter at different zenith angles were performed with the 
parameterization of the sea-level muon differential spec- 
tra (pQCD-1,2) taken from §. 

Omitting details, we dwell on a factor that may be 
useful in correcting the underwater muon flux, provided 
that it is crudely estimated with the continuous energy 
loss approximation (see Ref. fl3l| ). This factor is the ratio 
Rd/c °f the integral muon flux computed 
for discrete stochastic) muon energy losses, to the flux 
I™ nt (Efj,, h, 8) estimated with the continuous loss approx- 
imation. 

In Table || the ratio Rd/c is given as a function of the 
water depth and zenith angle for muon energies above 
10 GeV. As is seen the effect of discrete energy loss for 
the large depth is far from being small: Rd/ C 1S about 



TABLE II. Ratio R d/c = I* iBC /I° ont at > 10 GeV. 
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FIG. 2. Vertical muon flux as a function of water depth. 
The lines correspond to the n, 7^-muons calculated with the 
muon residual energy above 1 GeV (solid) and above 20 GeV 
(dashed). 

2 for the depth value of ~ 10 km w. e. The ratio is 
slightly affected by zenith-angular dependence of the sea- 
level muon flux. More precisely, the Rd/ C depends both 
on the "spectral index" of the muon flux and geometric 
factor of sec 9. The former varies weakly with zenith 
angle while the latter plays more important role in the 
Rd/c defining the thickness of water layer X — hsecQ 
that a muon overpasses {h indicates the vertical depth in 
km). 

For water the ratio Rd/ C a s a function of the slant depth 
X can be approximated with accuracy better than ~ 10% 
as 

R d/c = 0.99 + 0.02A + 6.74 • 10~ 4 A 3 , X = 1 - 12 km; 
R d /c = 1-43 + 0.054exp[(A - 1.19)/3.64], X = 12 - 35 km. 

The effect of the discrete loss increases as the muon 
energy grows. The energy dependence of the ratio Rd/ C 
is adequately illustrated by the following: for the depth 
of 12 km w. e. R d/c ^2.5 at =10 GeV and R d/c ^4.0 
at = 1 TeV. 

In Fig. ^ we present a comparison between the ex- 
pected muon vertical depth-intensity relation in water 
and the data obtained in underwater experiments (see 
for review ||, |l6|]), including recent measurements in 
the AMANDA-B4 experiment Jl|]. The computation 
was performed with water parameters: g = l<?/cm 3 , 
< Z >= 7.47, < A >= 14.87, < Z/A >= 0.5525, 
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FIG. 3. Zenith angle distribution of the muon flux under- 
water measured by Baikal NT-36 
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FIG. 4. Zenith angle distributions of the muon flux under- 
water measured with the AMANDA-B4 Ol. 



< Z 2 /A > = 3.77. The muon energy loss per lg/cm 2 
in ice is considered to be equal that in water but Qi ce — 
0.92 g/cm 3 . The calculations are presented for the muon 
residual energy (threshold of the detection) E„ >1 GeV 
(solid) and >20 GeV (dashed). This difference needs 
to be considered especially for shallow depth. 

Figs. H | show a comparison of the predicted 
muon zenith angle distribution (without considering the 
prompt muon contribution) with the measurements in 
the neutrino telescopes NT-36 (h| and AMANDA 0. 

The line in Fig. |^ presents the calculation for the muon 
threshold energy E„ =10 GeV at depth h =1.15 km. Our 
calculation is in reasonable agreement with the measure- 
ments of the NT-36 at all but the angle range 80 - 84°. 
In Fig. [|, the upper line relates to the flux at the depth 
h =1.60 km w. e. calculated for the muon residual en- 
ergy E^ >20 GeV, the lower one relates to h =1.68 km 
w. e. for the same energy threshold. The difference illus- 
trates the possible effect of an uncertainty in determining 
the average "trigger depth" JTtJ (relating to the center of 
gravity of all hit optical modules in the AMANDA-B4 ex- 
periment). The computed angle distribution agrees fairly 
well with the AMANDA-B4 data including zenith angles 
9 > 70°. 

The contributions of the (tt, K) and prompt muons un- 
derwater to zenith angle distribution at E^ > 100 TeV 
calculated for four values of depths (of 1.15 to 4 km) are 
shown in Fig. |g. Here we present the results obtained 
with the pQCD-1 (dashed) and the pQCD-2 (dotted). It 



is interesting to note that the dashed line representing 
the pQCD-1 prompt muon contribution twice intersects 
the line of the conventional flux at h = 1.15 km: near 
the vertical and at 9 ~ 75°. This can occur because of 




cos 9 



FIG. 5. Fluxes of muons above 100 TeV at water depth 
h — 1.15, 2, 3, 4 km (from top to bottom) as a function of 
cosine of the zenith angle. 
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h ( km w. e.) 

FIG. 6. The muon flux underwater against depth at 
cos 8 = 0.2. The contributions shown are the conventional 
muons (solid) and the prompt muons due to the pQCD-1 
(dashed) and the pQCD-2 model (dotted). 

the different zenith angle dependence of the conventional 
muon flux and the prompt muon one. And this means 
that at a depth of 1.15 km the nearly doubled muon event 
rate (for > 100 TeV) would be observed in the 0-75° 
range, instead of the rate expected due to conventional 
muons alone. 

There is no intersection of the pQCD-2 line at h = 
1.15 km up to 9 r~j 85°. The intersection point shifts to 
smaller zenith angles with increasing depth. For a depth 
of 2 km (nearly the AMANDA depth) it is possible to 
observe prompt muon fluxes that would be expected with 
the pQCD-2 at not too large angles (~ 70°). It should be 
mentioned that the underwater prompt muon flux will be 
distorted in a large zenith angle region because the angle 
isotropy approximation considered for the predictions of 
the pQCD models is valid only at 6 < 70° and < 
10 3 TeV. 

The depth dependence of the muon flux underwater at 
zenith angle of ~ 78° (Fig. ^J) indicates that in the case 
of the pQCD-1 one can observe the doubling of the muon 
flux at the Baikal depth of 1.15 km for > 100 TeV. At 
a depth ~ 2 km the same takes place even with the lesser 
prompt muon flux predicted with the pQCD-2 model. 

Fig. ^ shows muon integral energy spectra at a depth 
h = 1.15 km (Baikal) and 2 km (AMANDA) and for 
cos# = 0.2 (9 ~ 78.5°). Also presented are the predic- 
tions of the prompt muon flux issued from the pQCD-1 
(dashed) and pQCD-2 (dotted). The crossing energies 
E^{9) at the AMANDA depth are less than the ones at 
the Baikal depth by a factor of ~ 3. In particular, the 
PQCD-1 model gives E°(0 ~ 78.5°) « 30 TeV at h = 2 




E (GeV) 

FIG. 7. Integral muon spectra underwater at zenith angle 
9 = 78.5° at a depth of 1.15 km (upper) and of 2 km (lower). 
The contributions shown are the conventional muons (solid) 
and the prompt muons (dashed and dotted). 

km and ££(78.5°) « 100 TeV at a depth of 1.15 km. 
The same quantity calculated with pQCD-2 is 100 and 
250 TeV respectively. 

One can see (Fig. 0) that the AMANDA depth (~ 
2 km) gives, in a sense, the definite advantage in compar- 
ison with the Baikal one. Indeed, in the former case the 
assumed threshold energy is less, the muon flux differ- 
ence between the pQCD-1 model and the pQCD-2 one is 
larger (up to two orders of magnitude) , and the expected 
event rate remains approximately equal to the rate at the 
Baikal depth. 

It should be pointed out that muon residual energies 
below ~ 10 TeV and zenith angle 9 < 75° would be 
available (see Ref. |l(| for a discussion), in the above 
context, in future high-energy muon experiments with 
the NESTOR deep-sea detector ||^] which is expected to 
deploy at a depth of about 4 km. 

IV. SUMMARY 

Energy spectra and zenith angle distributions of the at- 
mospheric muons at high energies have been calculated 
for the depths from 1 to 4 km that correspond to the 
depths of operation of large underwater neutrino tele- 
scopes. The estimation of the prompt muon contribu- 
tion performed with the pQCD-1, 2 shows that the cross- 
ing energy E^ above which the prompt muon flux be- 
comes dominant over the conventional one, is within the 
range of ~ 200 to ~ 500 TeV at sea-level, depending on 
the choice of the parton distribution functions. For the 
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flux underwater at a zenith angle ~ 78°, the pQCD-1 
model leads to the value E° ~ 30 TeV (h = 2 km) and 
JSfj ~ 100 TeV (/i = 1.15 km). The corresponding cross- 
ing energies for the pQCD-2 model are E^ ~ 100 and 
Ef. ~ 250 TeV. 

The absolute value of the muon flux underwater around 
E^ depends on the charm production model. This cir- 
cumstance enables, in principle, bounds to be put on 
the charm production cross section based on measure- 
ments of zenith angle distributions of the muon flux at 
high energies. In particular, PDF sets under discussion, 
the MRSD- and the CTEQ3, differ in the small-x be- 
havior of the gluon distribution: xg{x) ~ x~ x , where 
A ~ 0.29 0.35 for the CTEQ3 against A = 0.5 for the 
MRSD- set. (See Ref. (TJ for the A-dependence of the 
sea- level prompt muon flux.) These PDFs yield inclusive 
cross sections of charmed particles produced in nucleon- 
air collisions and charm production cross sections that 
diverge rapidly from each other with increasing energy. 
For muon energies above 100 TeV and for cos (9 = 0.2 
these differences lead to the fact that prompt muon flux 
predicted with the pQCD-1 exceeds the flux arising from 
the pQCD-2 model by a factor of about 4 at h = 1.15 km 
or about 5 at h = 2 km. 

In conclusion we outline three probable ways for solv- 
ing of the prompt muon problem in the underwater exper- 
iments. First, one can measure zenith angle dependence 
of the muon flux in the energy region of 50 — 100 TeV 
(see Fig. ||): the expected event rate with the Baikal NT- 
200 is about 200 — 300 per year per steradian, supposing 
that the effective area of NT-200 is 10 4 m 2 for > 100 
TeV @. 

Second, the flux with muon energies E^ > 100 TeV 
measured as a function of depth (say, in depth region 
about 0.8 — 1.2 km) at a given zenith angle (~ 78°), could 
enable the charm production models to be discriminated 
(see Fig. ||) at the event rate level of about 200 per year 
per steradian. 

And last, one can attempt to extract information on 
the prompt muon flux underwater from muon integral 
spectra being measured at a given depth and at a given 
zenith angle (Fig. [?]). In this case the event rate is a factor 
7 less than in the previous one (with the NT-200 capabil- 
ities). It should be pointed out that the AMANDA depth 
of ~ 2 km provides some advantage: the threshold en- 
ergy is less, the muon flux difference between the pQCD-1 
model prediction and the pQCD-2 one is greater, and the 
expected event rate remains approximately equal to that 
at the Baikal depth. 
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